Display control device, display control method, and program for displaying an annotation toward a user

ABSTRACT

To be able to further facilitate interaction between users using AR technologies. Provided is a display control device including: a picture image acquiring unit configured to acquire a moving image corresponding to a sight of a first user in real time; a display control unit configured to display the moving image toward a second user different from the first user, and an annotation detection unit configured to detect that an annotation input by the second user with respect to the moving image is displayed in the sight of the first user or is output to be displayed. The display control unit further displays the displayed or output annotation toward the second user.

CROSS REFERENCE TO PRIOR APPLICATION

This application is a National Stage Patent Application of PCTInternational Patent Application No. PCT/JP2014/071387 (filed on Aug.13, 2014) under 35 U.S.C. § 371, which claims priority to JapanesePatent Application No. 2013-234933 (filed on Nov. 13, 2013), which areall hereby incorporated by reference in their entirety.

TECHNICAL FIELD

The present disclosure relates to a display control device, a displaycontrol method, and a program.

BACKGROUND ART

In recent years, technology known as augmented reality (AR) throughwhich users are presented with additional information that issuperimposed on the real world has been noticed. Information presentedto users in AR technology, which is also called annotation, can bevisualized using virtual objects of various forms such as text, icons,animation, and the like. For example, Patent Literature 1 discloses atechnology for realizing manipulation of virtual objects of such ARwithout impairing immersion of users in an AR space.

CITATION LIST Patent Literature

-   Patent Literature 1: JP 2012-212345A

SUMMARY OF INVENTION Technical Problem

The AR technology proposed in Patent Literature 1 and the like wasdeveloped recently and it is difficult to say that the technologies forutilizing AR in various phases have been proposed sufficiently. Forexample, the number of technologies for facilitating interaction betweenusers using AR technologies that have been proposed is still only one,and therefore insufficient.

It is desirable to provide a novel and improved image processing device,a novel and improved image processing method, and a novel and improvedprogram capable of further facilitating interaction between users usingAR technologies.

Solution to Problem

According to the present disclosure, there is provided a display controldevice including: a picture image acquiring unit configured to acquire amoving image corresponding to a sight of a first user in real time; adisplay control unit configured to display the moving image toward asecond user different from the first user, and an annotation detectionunit configured to detect that an annotation input by the second userwith respect to the moving image is displayed in the sight of the firstuser or is output to be displayed. The display control unit furtherdisplays the displayed or output annotation toward the second user.

According to the present disclosure, there is provided a display controlmethod including: acquiring a moving image corresponding to a sight of afirst user in real time; displaying the moving image toward a seconduser different from the first user, detecting, by a processor, that anannotation input by the second user with respect to the moving image isdisplayed in the sight of the first user or is output to be displayed;and displaying the displayed or output annotation toward the seconduser.

According to the present disclosure, there is provided a program forcausing a computer to implement: a function of acquiring a moving imagecorresponding to a sight of a first user in real time; a function ofdisplaying the moving image toward a second user different from thefirst user; a function of detecting that an annotation input by thesecond user with respect to the moving image is displayed in the sightof the first user or is output to be displayed; and a function ofdisplaying the displayed or output annotation toward the second user.

Advantageous Effects of Invention

According to an embodiment of the present disclosure described above, itis possible to further facilitate interaction between users using ARtechnologies.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a diagram illustrating a schematic configuration of a systemaccording to a first embodiment of the present disclosure.

FIG. 2 is a diagram illustrating a schematic configuration of a deviceaccording to the first embodiment of the present disclosure.

FIG. 3 is a diagram illustrating schematic functions and configurationof a system according to the first embodiment of the present disclosure.

FIG. 4 is a diagram illustrating an exemplary display in a wearabledisplay in the first embodiment of the present disclosure.

FIG. 5 is a diagram illustrating an exemplary display in a tabletterminal in the first embodiment of the present disclosure.

FIG. 6 is a diagram illustrating schematic functions and configurationof a system according to an exemplary variant of the first embodiment ofthe present disclosure.

FIG. 7 is a diagram illustrating schematic functions and configurationof a system according to a second embodiment of the present disclosure.

FIG. 8 is a diagram illustrating an example of a sequence in the secondembodiment of the present disclosure.

FIG. 9 is a diagram illustrating an exemplary display in a tabletterminal in the second embodiment of the present disclosure.

FIG. 10 is a diagram illustrating schematic functions and configurationof a system according to a third embodiment of the present disclosure.

FIG. 11 is a diagram illustrating a first exemplary display in a tabletterminal when an output rate is set at 0 temporarily in the thirdembodiment of the present disclosure.

FIG. 12 is a diagram illustrating a second exemplary display in a tabletterminal when an output rate is set at 0 temporarily in the thirdembodiment of the present disclosure.

FIG. 13 is a diagram illustrating schematic functions and configurationof a system according to a fourth embodiment of the present disclosure.

FIG. 14 is a diagram illustrating a first exemplary display in a tabletterminal in the fourth embodiment of the present disclosure.

FIG. 15 is a diagram illustrating a second exemplary display in a tabletterminal in the fourth embodiment of the present disclosure.

FIG. 16 is a block diagram for describing a hardware configuration thatcan configure an information processing apparatus according to anembodiment of the present disclosure.

DESCRIPTION OF EMBODIMENTS

Hereinafter, preferred embodiments of the present disclosure will bedescribed in detail with reference to the appended drawings. Note that,in this specification and the drawings, elements that have substantiallythe same function and structure are denoted with the same referencesigns, and repeated explanation is omitted.

Note that description will be made in the following order.

1. First Embodiment

1-1. System Configuration

1-2. Device Configuration

1-3. Function and Configuration

1-4. Exemplary Display

1-5. Exemplary Variant

2. Second Embodiment

2-1. Function and Configuration

2-2. Sequence Example

2-3. Exemplary Display

3. Third Embodiment

4. Fourth Embodiment

5. Hardware Configuration

6. Supplement

1. First Embodiment

(1-1. System Configuration)

FIG. 1 is a diagram illustrating a schematic configuration of a systemaccording to the first embodiment of the present disclosure. Referringto FIG. 1, the system 10 includes a wearable display 100, a smartphone150, a server 200, and a tablet terminal 300. The wearable display 100and the smartphone 150 are connected by Bluetooth (registeredtrademark), for example. Also, the server 200 is connected to thesmartphone 150 and the tablet terminal 300 via various types of wired orwireless networks.

In the system 10, a moving image captured by a camera (a head mountedcamera) equipped in the wearable display 100 of glasses type worn by afirst user is streamed and delivered in real time to the tablet terminal300 via the smartphone 150 and the server 200. The delivered movingimage can be processed in such a manner that its scope and orientationcorrespond to the sight of the first user. In this way, a second userthat browses the moving image on the tablet terminal 300 has anexperience as if sharing visual perception with the first user.

Further, the second user that browses the moving image on the tabletterminal 300 can input an annotation into the moving image that isstreamed and delivered. Here, the annotation is information added to andpresented in an image of a real space that the first user is viewing,and can take various types of forms, such as text, icon, or animation.The second user can add a comment to what appears in the sight of thefirst user, and can provide the first user with information, for exampleby the input of the annotation. That is, the second user can interferethe experience of the first user by the annotation.

The annotation input by the second user at the tablet terminal 300 istransmitted to the smartphone 150 via the server 200, and is displayedin the sight of the first user at the wearable display 100 by thecontrol of the smartphone 150. As described later, the annotation may bedisplayed transparently or translucently in the first sight, and may beintegrated into a picture image displayed toward the first user. In thisway, in the system 10, an interaction between users, which is mediatedby the moving image that is streamed and delivered, is established.

(1-2. Device Configuration)

FIG. 2 is a diagram illustrating a schematic configuration of devicesaccording to the first embodiment of the present disclosure. Note thatthe depicted components of each device is limited to the part related tothe function of the embodiment described below, and each device canfurther include components that are not depicted. The description of thehardware configuration of the information processing apparatus describedlater is to be referred to, with respect to a more detailedconfiguration of each device. In the following, with reference to FIG.2, the configuration of each device included in the system 10 will bedescribed.

(Wearable Display)

The wearable display 100 includes a display 110, a camera 120, and acommunication unit 130.

The display 110 is an LCD or an organic EL display for example, andpresents various types of information to the first user that wears thewearable display 100. More specifically, the display 110 may be atransparent display, and may be a closed display. When the display 110is transparent, the first user visually confirms the surrounding realspace through the display 110 directly. The display 110 electronicallydisplays additional information such as an annotation, to superimpose iton an image of the real space. On the other hand, when the display 110is a closed type, the first user visually confirms the surrounding realspace indirectly by a picture image of the real space created byprocessing the moving image captured by the camera 120 in such a mannerto correspond to the sight of the first user. The display 110 displays apicture image created by integrating the additional information such asthe annotation into the picture image of the real space. Note that, inthe following description, the display 110 can be either one of thetransparent type and the closed type, unless otherwise described.

The camera 120 is the above head mounted camera. The moving imagecaptured by the camera 120 is processed by a processor of one of thedevices described later in such a manner to correspond to the sight ofthe first user for example, and then is displayed toward the second userin the tablet terminal 300. Also, for example, when the display 110 isthe closed type, the picture image created by processing the movingimage captured by the camera 120 is displayed toward the first user aswell.

The communication unit 130 is a communication circuit that executescommunication by Bluetooth (registered trademark), with a communicationunit 180 a of the smartphone 150. In the present embodiment, the display110 and the camera 120 included in the wearable display 100 are remotelycontrolled by the smartphone 150.

Note that, in another embodiment, the wearable display 100 may include aprocessor and a memory for the control of the display 110 and the camera120 and other information processing. Also, in yet another embodiment,the display and the camera included in the smartphone 150 may be usedinstead of the wearable display 100. That is, the functions of thewearable display 100 and the smartphone 150 in the present embodimentmay be implemented by a single device including a display, a camera, aprocessor, and a memory, and may be implemented, distributed to aplurality of devices as in the depicted example, for example.

(Smartphone)

The smartphone 150 includes a processor 160, a memory 170, and acommunication unit 180.

The processor 160 executes various types of information processing inthe smartphone 150. For example, the processor 160 executes a controlfor displaying the annotation received from the server 200 via thecommunication unit 180 b on the display 110 of the wearable display 100.In this case, the processor 160 may notify the server 200 that theannotation is displayed on the display 110. Also, the processor 160 mayprocess the moving image captured by the camera 120 of the wearabledisplay 100, to deliver it to the tablet terminal 300 via the server200. The notification of the display of the annotation may betransmitted to the server 200 via the communication unit 180 b, togetherwith the processed moving image. Various types of data used inprocessing in the processor 160 is stored in the memory 170.

Note that, in the present embodiment, respective functions implementedby the processor 160 of the smartphone 150, a processor 210 of theserver 200, and a processor 310 of the tablet terminal 300 areinterchangeable. Thus, for example, the function described asimplemented by the processor 160 may be implemented by the processor 210or the processor 310 in another embodiment. In the same way, thefunction described as implemented by the processor 210 may beimplemented by the processor 160 or the processor 310 in anotherembodiment. Also, the function described as implemented by the processor310, data stored in the memory 170 of the smartphone 150, a memory 220of the server 200, and a memory 320 of the tablet terminal 300 inrespective embodiments differs depending on the function implemented bythe processor of each device.

The communication unit 180 includes a communication unit 180 a which isa communication circuit that executes communication by Bluetooth(registered trademark) with the communication unit 130 of the wearabledisplay 100, and a communication unit 180 b which is a communicationcircuit that executes network communication with a communication unit230 of the server 200. The network communication between thecommunication unit 180 b and the communication unit 230 can be executedvia various types of wired or wireless network, such as Wi-Fi, mobiletelephone network, and the Internet. This is the same in the networkcommunication between the communication unit 230 and a communicationunit 330 of the tablet terminal 300.

(Server)

The server 200 includes the processor 210, the memory 220, and thecommunication unit 230.

The processor 210 executes various types of information processing inthe server 200. For example, the processor 210 forwards the annotationreceived via the communication unit 230 from the tablet terminal 300, tothe smartphone 150. For example, when the moving image is delivered fromthe same wearable display 100 to a plurality of tablet terminals 300,the server 200 may collect annotations input by respective tabletterminals 300 and forward them to the smartphone 150. Also, theprocessor 210 delivers the moving image received via the communicationunit 230 from the smartphone 150, to one or a plurality of tabletterminals 300. In this case, the processor 210 may deliver informationrelevant to the annotation displayed in the wearable display 100, to thetablet terminal 300, on the basis of the notification from thesmartphone 150. Alternatively, the processor 210 may deliver theinformation of the annotation output to the smartphone 150, to thetablet terminal 300. Various types of data used in processing in theprocessor 210 is stored in the memory 220.

The communication unit 230 is a communication circuit that executesnetwork communication with the communication unit 180 b of thesmartphone 150, and the communication unit 330 of the tablet terminal300.

(Tablet Terminal)

The tablet terminal 300 includes the processor 310, the memory 320, thecommunication unit 330, a display 340, and a touch panel 350.

The processor 310 executes various types of information processing inthe tablet terminal 300. For example, the processor 310 executes acontrol for displaying the moving image received via the communicationunit 330 from the server 200, on the display 340. In this case, theprocessor 310 may display information indicating the annotationdisplayed in the sight of the first user in the wearable display 100 orthe annotation output from the server 200 or the smartphone 150 fordisplay, on the display 340 together with the moving image. Also, forexample, the processor 310 transmits the annotation input by the seconduser via the touch panel 350, to the server 200 via the communicationunit 330. Various types of data used in processing in the processor 310is stored in the memory 320.

The communication unit 330 is a communication circuit that executesnetwork communication with the communication unit 230 of the server 200.

The display 340 is an LCD and an organic EL display for example, andpresents various types of information in accordance with the control ofthe processor 310. For example, the display 340 displays the movingimage corresponding to the sight of the first user, which is generatedon the basis of the picture image captured by the camera 120 of thewearable display 100. Also, the display 340 displays informationindicating the annotation which is displayed in the sight of the firstuser or output for display. Further, the display 340 may display agraphical user interface (GUI) for the second user to input theannotation into the moving image.

The touch panel 350 is located on a front surface of the display 340,and detects a touch of the user as an input. The touch panel 350 detectsan input of text using software keyboard, a selection input of pictureimage or the like, and an input of character and pictorial figure byhandwriting, for example. The character and the picture image input viathe touch panel 350 is processed as the annotation by the processor 310,and is transmitted to the server 200 via the communication unit 330.

Although in the present embodiment the moving image corresponding to thesight of the first user that wears the wearable display 100 is deliveredto the tablet terminal 300, in another embodiment the moving image canbe delivered to various types of devices including a display and aninput device, such as a desktop or notebook personal computer, atelevision, a smartphone, a media player, or a game machine, in additionto the tablet terminal 300 or instead of the tablet terminal 300. Themoving image may be delivered on a wearable display different from thewearable display 100. In these cases, the input device is not limited tothe touch panel illustrated in the present embodiment, but may be akeyboard, a mouse, or a hardware button, for example. Also, audio inputand gesture input may be utilized to input the annotation.

(1-3. Function and Configuration)

FIG. 3 is a diagram illustrating the schematic functions andconfiguration of the system according to the first embodiment of thepresent disclosure. Referring to FIG. 3, the system 10 includes apicture image processing unit 251, a picture image acquiring unit 253, adisplay control unit 255, an annotation output control unit 257, adisplay control unit 259, and an annotation detection unit 261, asfunctions and configuration. These functions and configuration may beimplemented by one of the processor 160 of the smartphone 150, theprocessor 210 of the server 200, and the processor 310 of the tabletterminal 300 for example, and may be implemented, distributed to theseprocessors. In the following, each function and configuration will befurther described.

The picture image processing unit 251 processes the moving imagecaptured by the camera 120 equipped in the wearable display 100, inorder to generate the moving image corresponding to the sight of thefirst user that wears the wearable display 100. For example, the pictureimage processing unit 251 cuts out a region corresponding to the sight,from the moving image obtained by capturing an image of a wider scopethan the sight of the first user, in response to a result of calibrationexecuted in advance. Also, for example, the picture image processingunit 251 may correct the orientation of the moving image on the basis ofthe positional difference between the camera 120 and the viewpoint ofthe first user.

The picture image acquiring unit 253 acquires the moving image processedby the picture image processing unit 251, that is, the moving imagecorresponding to the sight of the first user, in real time. The displaycontrol unit 255 displays the acquired moving image on the display 340of the tablet terminal 300. As described above, the display 340 isbrowsed by the second user. This second user is different from the firstuser that wears the wearable display 100. Further, the display controlunit 255 displays the annotation on the display 340, on the basis of theinformation provided from the annotation detection unit 261 describedlater. Here, the displayed annotation is an annotation that is output tobe displayed in the sight of the first user.

The annotation output control unit 257 outputs the annotation that thesecond user inputs via the touch panel 350 of the tablet terminal 300,to display it in the sight of the first user. The display control unit259 displays the output annotation on the display 110 of the wearabledisplay 100. The wearable display 100 is worn by the first user, andtherefore the annotation displayed on the display 110 is displayed inthe sight of the first user. Note that, when the display 110 is theclosed type, the display control unit 259 further displays the pictureimage acquired from the picture image processing unit 251 on the display110.

The annotation detection unit 261 detects that the annotation input bythe second user into the moving image displayed on the display 340 atthe tablet terminal 300 is output from the annotation output controlunit 257. More specifically, the annotation detection unit 261 acquiresinformation indicating the output annotation, from the annotation outputcontrol unit 257. The annotation detection unit 261 supplies theinformation indicating the output annotation to the display control unit255.

By the above functions and configuration, the information indicating theoutput annotation can be displayed toward the second user, at a closertime point to the time point the annotation is actually displayed in thesight to the first user, for example. A difference can be generatedbetween the transmission time point and the display time point of theannotation, due to a communication delay between the tablet terminal 300and the server 200 or between the tablet terminal 300 and the smartphone150 for example, and thus this function and configuration can beeffective. Note that, when the above effect is considered, it isdesirable that the annotation output control unit 257 is configured witha processor of a device other than the tablet terminal 300 (because thecommunication delay does not have an influence when the annotationoutput control unit 257 is configured at the tablet terminal 300).

(1-4. Exemplary Display)

(Exemplary Display in Wearable Display)

FIG. 4 is a diagram illustrating an exemplary display at the wearabledisplay in the first embodiment of the present disclosure. Referring toFIG. 4, an image 1010 of the real space, a text 1021, and a stamp 1022are displayed in a screen image 1000 displayed on the display 110 of thewearable display 100.

The image 1010 of the real space may be visually confirmed through thetransparent display 110 directly as described above, and may be apicture image that is electronically displayed on the closed display110. In either case, the image 1010 of the real space is a picture imagecorresponding to the sight of the first user that wears the wearabledisplay 100.

The text 1021 and the stamp 1022 are each annotations input by the firstuser in the tablet terminal 300, into the image 1010 of the real spacedelivered as the moving image. The text 1021 and the stamp 1022 aretransparently or translucently superimposed on the image 1010 of thereal space, or are integrated into the picture image that forms theimage 1010 of the real space.

Note that, in the depicted example, the moving image is delivered to aplurality of tablet terminals 300, and the annotation is input at aplurality of tablet terminals 300. Thus, the text 1021 includes a nameof the user that inputs the annotation.

(Exemplary Display in Tablet Terminal)

FIG. 5 is a diagram illustrating an exemplary display at the tabletterminal in the first embodiment of the present disclosure. Referring toFIG. 5, a moving image 3010, a text 3021, a stamp 3022, a text input box3040, and a stamp selection box 3050 are displayed in a screen image3000 displayed on the display 340 of the tablet terminal 300.

The moving image 3010 is a picture image corresponding to the sight ofthe first user, which is generated by processing the moving imagecaptured by the camera 120 equipped in the wearable display 100. Themoving image 3010 is displayed in real time, except for the temporaldifference due to the communication delay and the like. That is, themoving image 3010 almost synchronizes with the image 1010 of the realspace displayed by the wearable display 100.

The text 3021 and the stamp 3022 are an annotation that is output to bedisplayed in the sight of the first user at the wearable display 100. Inthe depicted example, these annotation are integrated into the movingimage 3010. The display control unit 255 may execute a process forintegrating the annotation into the moving image 3010. Note that, inanother example, the annotation may be displayed separately from themoving image 3010.

The text input box 3040 is displayed to input a text of the annotation.The second user that uses the tablet terminal 300 locates a cursor onthe text input box 3040 by using the touch panel 350, and inputs a textby using a software keyboard, for example. The stamp selection box 3050is displayed to input a stamp of the annotation. The second user usesthe touch panel 350 for example, to select a stamp indicatingevaluation, remark or the like of the moving image 3010.

Here, the text 3021 and the stamp 3022 displayed in the screen image3000 are displayed on the basis of the information acquired via theannotation detection unit 261, at the time point when the annotationsare output from the annotation output control unit 257 implemented inthe server 200 or the smartphone 150 after the text and the stamp inputby using the text input box 3040 and the stamp selection box 3050 areonce transmitted to the server 200 from the tablet terminal 300, forexample. Thus, there is a little temporal difference by the time atwhich the text and the stamp input by using the text input box 3040 andthe stamp selection box 3050 are displayed as the text 3021 and thestamp 3022, and the temporal difference reflects a part of thedifference between the transmission time point and the display timepoint of the annotation.

(1-5. Exemplary Variant)

FIG. 6 is a diagram illustrating schematic functions and configurationof the system according to an exemplary variant of the first embodimentof the present disclosure. Referring to FIG. 6, in the system 12, theannotation output control unit 257 outputs the information of theannotation to the picture image processing unit 251 in addition to thedisplay control unit 259. The picture image processing unit 251 executesa process for integrating the annotation into the generated movingimage, in addition to processes for cutting out a region from the movingimage captured by the camera 120 and correcting the orientation. Thatis, in the present exemplary variant, the annotation is alreadyintegrated into the moving image processed by the picture imageprocessing unit 251, in other words, the moving image corresponding tothe sight of the first user. Thus, the picture image acquiring unit 253,which acquires the processed moving image, also acquires the informationof the annotation output together with the moving image, in order toimplement the function of the annotation detection unit 261 as well.

In the present exemplary variant, the moving image and the annotationare transmitted in an integrated state in a part at or after the pictureimage processing unit 251, and thus a temporal difference is notgenerated between the moving image and the annotation in this part dueto the communication delay, the processing delay, and the like. Thus,display of the moving image corresponding to the sight of the first userand the annotation output to be displayed in the sight of the first useris synchronized more accurately.

Also, when the display 110 of the wearable display 100 is the closedtype, the display control unit 259 displays the picture image acquiredfrom the picture image processing unit 251 on the display 110, so thatthe same relationship is established between the moving image and theannotation displayed by the wearable display 100 and the tablet terminal300. In this case, the annotation displayed on the display 340 of thetablet terminal 300 is the annotation that is actually displayed in thesight of the first user.

2. Second Embodiment

Next, the second embodiment of the present disclosure will be described.Note that duplicate description will be omitted with respect to the sameconfiguration (system configuration and device configuration) as theabove first embodiment.

(2-1. Function and Configuration)

FIG. 7 is a diagram illustrating schematic functions and configurationof the system according to the second embodiment of the presentdisclosure. Referring to FIG. 7, the system 20 includes a picture imageprocessing unit 251, a picture image acquiring unit 253, a displaycontrol unit 255, an annotation output control unit 257, a displaycontrol unit 259, an annotation detection unit 261, and an annotationqueue 263, as functions and configuration. The annotation queue 263added in the present embodiment can be configured with one of the memory170 of the smartphone 150, the memory 220 of the server 200, or thememory 320 of the tablet terminal 300, for example. In the following,these functions and configuration will be described with respect todifferent points from the first embodiment mainly.

The first user that wears the wearable display 100 acts in the realspace. Thus, the sight of the first user is needed to a certain extent,in order to act safely, and in order to view what he/she wants to view.Thus, in the example illustrated in FIG. 4, it is desirable that theregion in which the text 1021 and the stamp 1022 are the superimposed orintegrated is limited in the image 1010 of the real space displayed onthe display 110. Thus, in the case of the example of FIG. 4, the numberof the texts 1021 and the stamps 1022 that are simultaneously displayedon the display 110 may be limited to two, for example.

Also, the first user acts in the real space, and thus does notnecessarily dedicate himself or herself to visually confirming thedisplayed annotation. That is, it is assumed that the first uservisually confirms the annotation on the side in many cases. Thus, it isdesirable that the time for continuing display of the same annotation islonger than a case in which the user can dedicate himself or herself tovisually confirming the annotation.

By the above reason, in the present embodiment, the number ofannotations simultaneously displayed in the sight of the first user islimited to a predetermined threshold value or less, and the time forcontinuing the display of the same annotation is limited to apredetermined threshold value or more. Thus, the annotation outputcontrol unit 257 outputs the annotation that one or a plurality ofsecond users input via the touch panel 350 of the tablet terminal 300,at a predetermined rate that is decided according to the above displaynumber and/or the display continuing time. When the input rate of theannotation has exceeded a predetermined rate of the output, theannotation output control unit queues the input annotation in theannotation queue 263.

On the other hand, when the annotation output control unit 257 queuesthe annotation as described above, it is possible that the communicationis not smooth, without knowing the timing at which the input comment isdisplayed in the sight of the first user, from the view point of thecommunication between the second user that inputs the annotation and thefirst user that browses the annotation.

In the present embodiment, in the same way as the above firstembodiment, the annotation detection unit 261 detects that theannotation is output from the annotation output control unit 257, andinformation indicating the output annotation is supplied to the displaycontrol unit 255. The display control unit 255 displays the outputannotation on the display 340 of the tablet terminal 300, on the basisof this information. Thus, the second user can know the timing at whichthe input comment is output to be displayed in the sight of the firstuser, and can input the next comment after the comment input in advanceis output, for example.

Further, the annotation detection unit 261 may detect that the inputannotation is queued to be displayed or output. In this case,information indicating the queued annotation is supplied to the displaycontrol unit 255, in addition to the information indicating the outputannotation. The display control unit 255 displays the queued annotationon the display 340, on the basis of this information. Thereby, thesecond user can know that it is a state in which the input annotation isqueued. Also, the second user can predict a timing at which the inputannotation is displayed in the sight of the first user.

In the above case, the annotation output control unit 257 may delete atleast a part of the queued annotation, on the basis of operation of thesecond user via the touch panel 350. Thereby, for example, when losing achance while the annotation is queued, the second user can delete theannotation that is meaningless now, from the queue by the operation ofhimself or herself. For example, when there is a plurality of secondusers, each user can perform the above operation, and thus the sight ofthe first user is prevented from being blocked by meaninglessannotations that have lost chances.

(2-2. Sequence Example)

FIG. 8 is a diagram illustrating an example of the sequence in thesecond embodiment of the present disclosure. Note that FIG. 8illustrates a case in which the display control unit 255, the annotationoutput control unit 257, and the annotation detection unit 261 areimplemented in the server 200. Referring to FIG. 8, first, the inputannotation is transmitted from the tablet terminal 300 to the server 200(S101). In the depicted example, here, the annotation output controlunit 257 queues the annotation. The annotation detection unit 261detects that the annotation is queued, and supplies the informationindicating the annotation to the display control unit 255. The queuedannotation is displayed on the display 340 in the tablet terminal 300,in accordance with the information transmitted from the display controlunit 255 (S103).

Thereafter, when the annotation output control unit 257 takes out theabove annotation from the annotation queue 263 and outputs it to displayit at the wearable display 100 (S105), the annotation detection unit 261detects that the annotation is output, and supplies the informationindicating the annotation to the display control unit 255. Theannotation output to the display 340 is displayed at the tablet terminal300, in accordance with the information transmitted from the displaycontrol unit 255 (S107).

(2-3. Exemplary Display)

FIG. 9 is a diagram illustrating an exemplary display at the tabletterminal in the second embodiment of the present disclosure. Note thatan exemplary display at the wearable display 100 is the same as theabove first embodiment, and thus its description will be omitted.Referring to FIG. 9, queued texts 3131 and queued stamps 3132 aredisplayed in the screen image 3100 displayed on the display 340 of thetablet terminal 300, in addition to the same moving image 3010, text3021, stamp 3022, text input box 3040, and stamp selection box 3050 asthe screen image 3000 described with reference to FIG. 5 in the firstembodiment.

The queued texts 3131 and the stamps 3132 are displayed in a differentform from the text 3021 and the stamp 3022 integrated into the movingimage 3010. More specifically, the texts 3131 and the stamps 3132 arearranged under the moving image 3010. This arrangement corresponds tothe state of the annotation queue 263. That is, in the state of thedepicted example, what the annotation output control unit 257 outputsnext are the texts 3131 a and the stamp 3132 a, and what are output nextto them are the texts 3131 b and the stamp 3132 b, and then what areoutput next to them are the texts 3131 c and the stamp 3132 c.

3. Third Embodiment

Next, the third embodiment of the present disclosure will be described.Note that duplicate description will be omitted with respect to the sameconfiguration (system configuration and device configuration, etc.) asthe above first and second embodiments.

FIG. 10 is a diagram illustrating schematic functions and configurationof the system according to the third embodiment of the presentdisclosure. Referring to FIG. 10, in the system 30, an output ratesetting unit 265 is further implemented as a function and configuration.Also, in the system 30, an operation button/sensor 140 is provided inthe wearable display 100. The output rate setting unit 265 may set apredetermined rate at which the annotation output control unit 257outputs the annotation, on the basis of operation of the first user viathe operation button, for example. Alternatively, the output ratesetting unit 265 may set a predetermined rate at which the annotationoutput control unit 257 outputs the annotation, on the basis of sensinginformation of the first user acquired by the sensor.

Thereby, for example, the first user that wears the wearable display 100can increase the output rate of the annotation by the operation via theoperation button or the like, when determining that he or she can bededicated to visually confirming the annotation. For example, byincreasing the output rate, the annotation may be displayed by using awider region of the display 110, and the time during which the displayof the same annotation is continued may be shortened. Note that theoperation button of the wearable display 100 may be replaced by an inputdevice such as a touch panel included in a smartphone 150, audio input,gesture input, or the like, for example.

Alternatively, when a predetermined operation by the first user isacquired via the operation button, the annotation output control unit257 may set the output rate of the annotation by the annotation outputcontrol unit 257 at the maximum value, until the amount of theannotation queued in the annotation queue 263 becomes less than apredetermined threshold value. When the output rate is set at themaximum value, the annotation is displayed on the entire display 110,and the display continuing time of the annotation is set at the minimumlimit, for example. Thereby, when the first user can be dedicated tovisually confirming the annotation, by stopping acting for example, thequeued annotations are displayed at a time, in order to create a statein which input annotations are displayed immediately when startingacting again.

Also, for example, the output rate setting unit 265 may estimate thesurrounding environment of the first user on the basis of the sensinginformation of the first user, and set the output rate on the basis ofthe result of the estimation. More specifically, for example, the outputrate setting unit 265 may decrease the output rate, when it is estimatedthat the first user is exercising (for example, walking and running,etc.) on the basis of the detection result of an acceleration sensorequipped in the wearable display 100. Also, for example, the output ratesetting unit 265 may decrease the output rate, when it is estimated thatthe first user is in a bustling site, on the basis of the detectionresult of a sound sensor equipped in the wearable display 100.

In order to decrease the output rate in this case, the output ratesetting unit 265 may set the output rate at 0 temporarily. When theoutput rate is set at 0, the annotation output control unit 257 does notoutput the annotation, and the annotation is not displayed on thedisplay 110 of the wearable display 100. While the annotation is notdisplayed, a fewer objects are superimposed on the image of the realspace to be displayed on the display 110 (it is possible that objectsother than the annotation continues to be displayed), and therefore thefirst user easily concentrates on visual confirmation of the image ofthe real space, in order to improve safety of act in the real space, andin order to concentrate on viewing what he/she wants to view. Note thatthe output rate setting unit 265 may set the output rate at 0temporarily, in accordance with the operation of the first user via theoperation button or the like.

FIG. 11 is a diagram illustrating the first exemplary display at thetablet terminal when the output rate is set at 0 temporarily in thethird embodiment of the present disclosure. Note that the wearabledisplay 100 is in a state in which the annotation is not displayed, andthus depiction and detailed description of its exemplary display will beomitted. Referring to FIG. 11, in the screen image 3200 displayed on thedisplay 340 of the tablet terminal 300, the same moving image 3010, textinput box 3040, and stamp selection box 3050 as the screen image 3000described with reference to FIG. 5 in the first embodiment, and anannotation undisplay notification 3260 are displayed.

The annotation undisplay notification 3260 is displayed on the basis ofthe information supplied from the annotation output control unit 257 viathe annotation detection unit 261 to the display control unit 255, whenthe output rate setting unit 265 sets the output rate of the annotationat 0 temporarily, for example. Alternatively, the annotation undisplaynotification 3260 may be displayed on the basis of the informationsupplied from the annotation output control unit 257 via the annotationdetection unit 261 to the display control unit 255, when the second userinputs a new annotation at the tablet terminal 300 while the output rateof the annotation is set at 0 temporarily. Note that, in this example,the annotation output control unit 257 queues the annotation input whilethe output rate is 0, in the annotation queue 263.

FIG. 12 is a diagram illustrating a second exemplary display at thetablet terminal when the output rate is set at 0 temporarily in thethird embodiment of the present disclosure. Referring to FIG. 12, in thescreen image 3300 displayed on the display 340 of the tablet terminal300, the same moving image 3010, text input box 3040, stamp selectionbox 3050, queued texts 3131, and stamps 3132 as the screen image 3100described with reference to FIG. 9 in the second embodiment, and thesame undisplay notification 3260 as the above first example aredisplayed.

In this example, the second user that uses the tablet terminal 300 canknow that the input annotation is not displayed in the sight of thefirst user temporarily, as well as the order in which the annotationsare displayed when the display of the annotation is restarted. Thus, forexample, as in the example described in the above second embodiment,when there is an annotation that loses a chance and becomes meaninglesswhile the display of the annotation is suppressed, the second user thathas input the annotation can delete the annotation from the queue.

4. Fourth Embodiment

Next, the fourth embodiment of the present disclosure will be described.Note that duplicate description will be omitted with respect to the sameconfiguration (system configuration and device configuration, etc.) asthe above first to third embodiments.

FIG. 13 is a diagram illustrating schematic functions and configurationof the system according to the fourth embodiment of the presentdisclosure. Referring to FIG. 13, in the system 40, a gaze detectionunit 267 is further implemented as function and configuration. Also, inthe system 40, an eye camera 145 is provided in the wearable display100. The gaze detection unit 267 detects a sight line of the first userthat wears the wearable display 100 from the captured image by the eyecamera 145, and detects that the annotation displayed on the display1100 is gazed by the first user. More specifically, for example, thegaze detection unit 267 may detect that the annotation is gazed when thesight line of the first user is identical with the displayed annotation,and may detect that the annotation is gazed when the direction of thesight line of the first user is almost identical with the direction inwhich the annotation is displayed.

Further, the result of the detection by the gaze detection unit 267 issupplied to the annotation detection unit 261. That is, in the presentembodiment, the annotation detection unit 261 detects that theannotation is output on the basis of the information supplied from theannotation output control unit 257, and also detects that the annotationis gazed on the basis of the information supplied from the gazedetection unit 267. The display control unit 255 displays theannotations that are output to be displayed in the wearable display 100,on the display 340 of the tablet terminal 300, and displays anotification indicating these annotations are visually confirmed, on thedisplay 340, on the basis of the information supplied from theannotation detection unit 261.

FIG. 14 is a diagram illustrating a first exemplary display at thetablet terminal in the fourth embodiment of the present disclosure. Notethat an exemplary display at the wearable display 100 is the same as theabove first embodiment, and thus the description will be omitted.Referring to FIG. 14, in the screen image 3400 displayed on the display340 of the tablet terminal 300, the same moving image 3010, text 3021,stamp 3022, text input box 3040, and stamp selection box 3050 as thescreen image 3000 described with reference to FIG. 5 in the firstembodiment, and a gaze icon 3470 are displayed.

The gaze icon 3470 is displayed with respect to the annotation detectedby the annotation detection unit 261 in order to indicate that theannotation is gazed by the first user. With the gaze icon 3470 that isdisplayed, the second user that uses the tablet terminal 300 can knowthat the input annotation is displayed at the wearable display 100, andfurther that it is gazed by the first user.

FIG. 15 is a diagram illustrating a second exemplary display at thetablet terminal in the fourth embodiment of the present disclosure.Referring to FIG. 15, in the screen image 3500 displayed on the display340 of the tablet terminal 300, the same moving image 3010, text 3021,stamp 3022, text input box 3040, stamp selection box 3050, and queuedtexts 3131 and stamps 3132 as the screen image 3100 described withreference to FIG. 9 in the second embodiment, and the same gaze icon3470 as the above first example are displayed. As illustrated in thisdrawing, the gaze icon 3470 may be displayed together with the queuedtexts 3131 and stamps 3132.

5. Hardware Configuration

Next, with reference to FIG. 16, a hardware configuration that iscapable of realizing an information processing apparatus according to anembodiment of the present disclosure will be described. FIG. 8 is ablock diagram showing a hardware configuration of an informationprocessing apparatus. An information processing apparatus 900 which isshown may achieve the smartphone 150, the server 200, and the tabletterminal 300 in the above described embodiments, for example.

The information processing apparatus 900 includes a central processingunit (CPU) 901, read only memory (ROM) 903, and random access memory(RAM) 905. Further, the information processing apparatus 900 may alsoinclude a host bus 907, a bridge 909, an external bus 911, an interface913, an input device 915, an output device 917, a storage device 919, adrive 921, a connection port 923, and a communication device 925.Furthermore, the information processing apparatus 900 may include animaging device 933 and a sensor 935 as necessary. The informationprocessing apparatus 900 may also include, instead of or along with theCPU 901, a processing circuit such as a digital signal processor (DSP)or an application specific integrated circuit (ASIC).

The CPU 901 functions as an arithmetic processing unit and a controlunit and controls an entire operation or a part of the operation of theinformation processing apparatus 900 according to various programsrecorded in the ROM 903, the RAM 905, the storage device 919, or aremovable recording medium 927. The ROM 903 stores programs andarithmetic parameters used by the CPU 901. The RAM 905 primarily storesprograms used in execution of the CPU 901 and parameters and the likevarying as appropriate during the execution. The CPU 901, the ROM 903,and the RAM 905 are connected to each other via the host bus 907configured from an internal bus such as a CPU bus or the like. Inaddition, the host bus 907 is connected to the external bus 911 such asa peripheral component interconnect/interface (PCI) bus via the bridge909.

The input device 915 is a device operated by a user, such as a mouse, akeyboard, a touch panel, buttons, a switch, and a lever. Also, the inputdevice 915 may be a remote control device using, for example, infraredlight or other radio waves, or may be an external connection device 929such as a cell phone compatible with the operation of the informationprocessing apparatus 900. The input device 915 includes an input controlcircuit that generates an input signal on the basis of information inputby the user and outputs the input signal to the CPU 901. The user inputsvarious kinds of data to the information processing apparatus 900 andinstructs the information processing apparatus 900 to perform aprocessing operation by operating the input device 915.

The output device 917 is configured from a device capable of visually oraurally notifying the user of acquired information. For example, theoutput device 917 may be: a display device such as a liquid crystaldisplay (LCD), a plasma display panel (PDP), or an organicelectro-luminescence (EL) display; an audio output device such as aspeaker or headphones; or a printer. The output device 917 outputsresults obtained by the processing performed by the informationprocessing apparatus 900 as video in the form of text or an image or asaudio in the form of audio or sound.

The storage device 919 is a device for storing data configured as anexample of a storage unit of the information processing apparatus 900.The storage device 919 is configured from, for example, a magneticstorage device such as a hard disk drive (HDD), a semiconductor storagedevice, an optical storage device, or a magneto-optical storage device.This storage device 919 stores programs to be executed by the CPU 901,various data, and various data obtained from the outside.

The drive 921 is a reader/writer for the removable recording medium 927such as a magnetic disk, an optical disc, a magneto-optical disk, or asemiconductor memory, and is built in or externally attached to theinformation processing apparatus 900. The drive 921 reads outinformation recorded on the attached removable recording medium 927, andoutputs the information to the RAM 905. Further, the drive 921 writesthe record on the attached removable recording medium 927.

The connection port 923 is a port for allowing devices to directlyconnect to the information processing apparatus 900. Examples of theconnection port 923 include a universal serial bus (USB) port, anIEEE1394 port, and a small computer system interface (SCSI) port. Otherexamples of the connection port 923 may include an RS-232C port, anoptical audio terminal, and a high-definition multimedia interface(HDMI) port. The connection of the external connection device 929 to theconnection port 923 may enable the various data exchange between theinformation processing apparatus 900 and the external connection device929.

The communication device 925 is a communication interface configuredfrom, for example, a communication device for establishing a connectionto a communication network 931. The communication device 925 is, forexample, a wired or wireless local area network (LAN), Bluetooth(registered trademark), a communication card for wireless USB (WUSB), orthe like. Alternatively, the communication device 925 may be a routerfor optical communication, a router for asymmetric digital subscriberline (ADSL), a modem for various communications, or the like. Thecommunication device 925 can transmit and receive signals and the likeusing a certain protocol such as TCP/IP on the Internet and with othercommunication devices, for example. The communication network 931connected to the communication device 925 is configured from a networkwhich is connected via wire or wirelessly and is, for example, theInternet, a home-use LAN, infrared communication, radio wavecommunication, and satellite communication.

The imaging device 933 is a device which images a real space by use ofvarious members including an image sensor such as a charge coupleddevice (CCD) or a complementary metal oxide semiconductor (CMOS) and alens for controlling image formation of a subject on the image sensor,and generates a pickup image. The imaging device 933 may image a stillimage or a moving image.

The sensor 935 is any of various sensors such as an acceleration sensor,a gyro sensor, a magnetic field sensor, an optical sensor, and a soundsensor. For example, the sensor 935 acquires information related to thestate of the information processing apparatus 900 itself, such as theposture of the housing of the information processing apparatus 900, orinformation related to the peripheral environment of the informationprocessing apparatus 900, such as the brightness or noise around theinformation processing apparatus 900. Further, the sensor 935 mayinclude a global positioning system (GPS) sensor which measures thelatitude, the longitude, and the altitude of the apparatus by receivinga GPS signal.

Heretofore, an example of the hardware configuration of the informationprocessing apparatus 900 has been shown. Each of the structural elementsdescribed above may be configured using a general-purpose material, ormay be configured from hardware dedicated to the function of eachstructural element. The configuration may be changed as appropriateaccording to the technical level at the time of carrying outembodiments.

6. Supplement

The embodiments of the present disclosure may include the informationprocessing apparatus (a smartphone, a server or a tablet terminal), thesystem, the information processing method executed in the informationprocessing apparatus or the system, the program for causing theinformation processing apparatus to function, and the non-transitorytangible media having the program recorded thereon, which have beendescribed above, for example.

The preferred embodiments of the present disclosure have been describedabove with reference to the accompanying drawings, whilst the presentdisclosure is not limited to the above examples, of course. A personskilled in the art may find various alterations and modifications withinthe scope of the appended claims, and it should be understood that theywill naturally come under the technical scope of the present disclosure.

Additionally, the present technology may also be configured as below.

(1)

A display control device including:

a picture image acquiring unit configured to acquire a moving imagecorresponding to a sight of a first user in real time;

a display control unit configured to display the moving image toward asecond user different from the first user; and

an annotation detection unit configured to detect that an annotationinput by the second user with respect to the moving image is displayedin the sight of the first user or is output to be displayed,

wherein the display control unit further displays the displayed oroutput annotation toward the second user.

(2)

The display control device according to (1), wherein

the annotation detection unit further detects that the annotation isqueued to be displayed or to be output, and

the display control unit displays the queued annotation toward thesecond user.

(3)

The display control device according to (2), wherein

the display control unit displays the displayed or output annotation andthe queued annotation in forms that are different from each other.

(4)

The display control device according to any one of (1) to (3), furtherincluding:

an annotation output control unit configured to output the annotation ata predetermined rate to display the annotation in the sight of the firstuser, and queue the annotation that is input over the predeterminedrate.

(5)

The display control device according to (4), further including:

an output rate setting unit configured to set the predetermined rate onthe basis of an operation performed by the first user or sensinginformation of the first user.

(6)

The display control device according to (5), wherein

the output rate setting unit sets the predetermined rate at 0temporarily, on the basis of the sensing information of the first user.

(7)

The display control device according to (6), wherein

the display control unit further displays a notification indicating thatthe predetermined rate is 0, toward the second user.

(8)

The display control device according to any one of (5) to (7), wherein

the output rate setting unit sets the predetermined rate at a maximumvalue until an amount of the queued annotation becomes less than apredetermined threshold value, on the basis of the operation performedby the first user.

(9)

The display control device according to any one of (4) to (8), wherein

the annotation output control unit deletes at least a part of the queuedannotation on the basis of an operation performed by the second user.

(10)

The display control device according to any one of (1) to (9), wherein

the annotation detection unit further detects that the displayed oroutput annotation is gazed by the first user, and

the display control unit further displays a notification indicating thatthe displayed or output annotation is gazed, toward the second user.

(11)

The display control device according to any one of (1) to (10), wherein

the display control unit displays the moving image into which thedisplayed or output annotation is integrated, toward the second user.

(12)

The display control device according to (11), wherein

the display control unit executes a process for integrating thedisplayed or output annotation into the moving image.

(13)

The display control device according to (11), wherein

the annotation detection unit is implemented by the picture imageacquiring unit that acquires the moving image into which the displayedor output annotation is integrated.

(14)

A display control method including:

acquiring a moving image corresponding to a sight of a first user inreal time;

displaying the moving image toward a second user different from thefirst user,

detecting, by a processor, that an annotation input by the second userwith respect to the moving image is displayed in the sight of the firstuser or is output to be displayed; and

displaying the displayed or output annotation toward the second user.

(15)

A program for causing a computer to implement:

a function of acquiring a moving image corresponding to a sight of afirst user in real time;

a function of displaying the moving image toward a second user differentfrom the first user;

a function of detecting that an annotation input by the second user withrespect to the moving image is displayed in the sight of the first useror is output to be displayed; and

a function of displaying the displayed or output annotation toward thesecond user.

REFERENCE SIGNS LIST

-   10, 12, 20, 30, 40 system-   100 wearable display-   110 display-   120 camera-   140 sensor-   145 eye camera-   150 smartphone-   160 processor-   170 memory-   200 server-   210 processor-   220 memory-   251 picture image processing unit-   253 picture image acquiring unit-   255 display control unit-   257 annotation output control unit-   261 annotation detection unit-   263 annotation queue-   265 output rate setting unit-   267 gaze detection unit-   300 tablet terminal-   310 processor-   320 memory-   340 display-   350 touch panel

The invention claimed is:
 1. A display control device comprising:circuitry configured to: acquire a moving image corresponding to a sightof a first user in real time; initiate display of the moving image on adisplay toward a second user different from the first user; detect thatan annotation input by the second user with respect to the moving imageis displayed in the sight of the first user or is output to bedisplayed; initiate display of the displayed or output annotation onanother display in the sight of the first user; initiate display of thedisplayed or output annotation on the display toward the second user;detect that the displayed or output annotation displayed on the anotherdisplay is gazed by the first user; initiate, on the display toward thesecond user, display of a notification indicating that the displayed oroutput annotation displayed on the another display is gazed by the firstuser; output the annotation at a predetermined rate to display theannotation on the another display in the sight of the first user, andqueue the annotation that is input over the predetermined rate; and setthe predetermined rate on the basis of an operation performed by thefirst user or sensing information of the first user.
 2. The displaycontrol device according to claim 1, wherein the circuitry is furtherconfigured to: detect that the annotation is queued to be displayed orto be output; and initiate display of the queued annotation on thedisplay toward the second user, the queued annotation and the displayedor output annotation being displayed concurrently on the display towardthe second user.
 3. The display control device according to claim 2,wherein the circuitry is further configured to: initiate display of thedisplayed or output annotation on the display in a first form anddisplay of the queued annotation on the display in a second form, thefirst form and the second form being different from each other.
 4. Thedisplay control device according to claim 2, wherein the circuitry isfurther configured to: initiate, on the display toward the second user,display of the displayed or output annotation integrated into the movingimage; and initiate, on the display toward the second user, display ofthe queued annotation on the display toward the second user outside themoving image.
 5. The display control device according to claim 1,wherein the circuitry is further configured to: set the predeterminedrate at 0 temporarily, on the basis of the sensing information of thefirst user.
 6. The display control device according to claim 5, whereinthe circuitry is further configured to: initiate, on the display towardthe second user, display of a notification indicating that thepredetermined rate is
 0. 7. The display control device according toclaim 1, wherein the circuitry is further configured to: set thepredetermined rate at a maximum value until an amount of the queuedannotation becomes less than a predetermined threshold value, on thebasis of the operation performed by the first user.
 8. The displaycontrol device according to claim 1, wherein the circuitry is furtherconfigured to: delete at least a part of the queued annotation on thebasis of an operation performed by the second user.
 9. The displaycontrol device according to claim 1, wherein the circuitry is furtherconfigured to: initiate, on the display toward the second user, displayof the notification indicating that the displayed or output annotationis gazed by the first user, based on detecting that the displayed oroutput annotation is gazed by the first user.
 10. The display controldevice according to claim 1, wherein the circuitry is further configuredto: initiate, on the display toward the second user, display of themoving image into which the displayed or output annotation isintegrated.
 11. The display control device according to claim 10,wherein the circuitry is further configured to: execute a process forintegrating the displayed or output annotation into the moving image.12. The display control device according to claim 1, wherein thecircuitry is further configured to: detect that the displayed or outputannotation is gazed by the first user when a sight line of the firstuser is identical with a direction in which the displayed or outputannotation is displayed on the another display.
 13. The display controldevice according to claim 1, wherein the circuitry is configured to:detect that a sight line of the first user is identical with a directionin which the displayed or output annotation is displayed on the anotherdisplay; and detect that the displayed or output annotation is gazed bythe first user, based on detecting that the sight line of the first useris identical with the direction in which the displayed or outputannotation is displayed on the another display.
 14. A display controlmethod comprising: acquiring a moving image corresponding to a sight ofa first user in real time; displaying the moving image on a displaytoward a second user different from the first user; detecting, by aprocessor, that an annotation input by the second user with respect tothe moving image is displayed in the sight of the first user or isoutput to be displayed; displaying the displayed or output annotation onanother display in the sight of the first user; displaying the displayedor output annotation on the display toward the second user; detectingthat the displayed or output annotation displayed on the another displayis gazed by the first user; displaying, on the display toward the seconduser, a notification indicating that the displayed or output annotationdisplayed on the another display is gazed by the first user; outputtingthe annotation at a predetermined rate to display the annotation on theanother display in the sight of the first user, and queue the annotationthat is input over the predetermined rate; and setting the predeterminedrate on the basis of an operation performed by the first user or sensinginformation of the first user.
 15. A non-transitory computer-readablemedium having embodied thereon a program, which when executed by acomputer causes the computer to execute a method, the method comprising:acquiring a moving image corresponding to a sight of a first user inreal time; displaying the moving image on a display toward a second userdifferent from the first user; detecting that an annotation input by thesecond user with respect to the moving image is displayed in the sightof the first user or is output to be displayed; displaying the displayedor output annotation on another display in the sight of the first user;displaying the displayed or output annotation on the display toward thesecond user; detecting that the displayed or output annotation displayedon the another display is gazed by the first user; displaying, on thedisplay toward the second user, a notification indicating that thedisplayed or output annotation displayed on the another display is gazedby the first user; outputting the annotation at a predetermined rate todisplay the annotation on the another display in the sight of the firstuser, and queue the annotation that is input over the predeterminedrate; and setting the predetermined rate on the basis of an operationperformed by the first user or sensing information of the first user.